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PREFACE 


Part  of  the  Project  RAND  research  program  consists  of 
basic  supporting  studies  in  mathematics.  In  this  Memorandum 
the  author  shows  that  several  problems  which  are  usually 
treated  by  other  methods  can  be  regarded  as  problems  of 
minimum  cost  flows,  and  that  an  algorithm  of  shortest- 
path  type  can  be  used  to  solve  all  of  them. 

Dr.  T.  C.  Hu,  on  leave  from  the  IBM  Research  Center, 
is  currently  teaching  at  the  Operations  Research  Center  of 
the  University  of  California  at  Berkeley.  He  was  a 
Consultant  to  the  Mathematics  Department  of  The  RAND 
Corporation  during  the  summer  of  1964. 


SUMMARY 


An  algorithm  is  given  for  solving  minimum  cost  flow 
problems  where  the  shipping  cost  over  an  arc  is  a  convex 
function  of  the  number  of  units  shipped  along  that  arc. 

This  provides  a  unified  way  of  looking  at  many  seemingly 
unrelated  problems  in  different  areas.  For  example,  problems 
associated  with  electrical  networks,  with  increasing  the 
capacity  of  a  network  under  a  fixed  budget,  with  Laplace 
equations,  and  with  the  Max-Flow  Min-Cut  Theorem  may  all  be 
formulated  into  minimum  convex-cost  flow  pruolems. 
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MINIMUM  CONVEX-COST  FLOWS  IN  NETWORKS 


1.  INTRODUCTION 

Consider  a  connected  network  consisting  of  nodes  N^ 
and  arcs  A£j  leading  from  to  N..  Among  the  nodes  N., 

J  X 

there  is  a  special  node  Ng  called  the  source,  and  a 

special  node  Nt  called  the  sink.  The  flow  from  N.  to  N. 

in  the  arc  A^  is  denoted  by  x^.  We  consider  the  follow- 
ing  problem: 


(1)  Min  z  «  2  c .  .  (x.  .)  , 

ij  v  iJT  ’ 


subject  to 


for  j  =  s  , 
for  j  +  s,t, 
for  j  -  t  , 


where  c^j(x^.)  are  nonnegative  convex  functions  of  x. . 

LJ 

and  the  arc  flows  are  required  to  be  positive  integers 
or  zero.  Note  that  Eqs.  (2)  express  the  conservation  of 
flow  at  nodes  other  than  the  source  and  the  sink,  and  that 
the  objective  function  (1)  is  a  sum  of  convex  functions 
(not  necessarily  strictly  convex),  and  is  thus  convex. 

We  shall  discuss  in  Sec.  3  how  this  problem  is  related 
to  problems  of  finding  maximum  flow  in  a  network  with  arc- 
capacity  restrictions,  problems  in  the  synthesis  of  traffic 
or  communication  systems,  electrical-network  problems, 
and  certain  boundary-value  problems.  Similar  work  has  been 
done  in  this  area  (See  [1],[3J,[7],  and  [10]).  in  [3], linear 
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cost  functions  (x^j)  are  considered  ;  the  method  of 

[1]  deals  with  bipartite  networks  and  starts  with  a  feasible 

solution. 

The  algorithm  presented  in  this  paper  deals  with 
general  convex-cost  functions  in  an  arbitrary  network  and 
gives  a  feasible  solution  which  is  optimal  for  the  parameter 
v.  In  spirit,  it  is  closely  related  to  that  of  [1]  and  [3]. 

A  set  of  positive  x^  satisfying  (2)  is  called  a  flow 
pattern  with  value  v.  A  flow  pattern  which  minimizes  (1) 
for  fixed  v  is  called  an  optimal  flow  pattern  corresponding 
to  v.  Since  the  cost  of  shipping  the  flow  along  an  arc  is 
a  convex  function  of  the  amount  of  flow  shipped,  the  cost 
of  shipping  one  additional  unit  of  flow  along  the  arc  will  * 
depend  on  how  much  flow  already  exists  on  the  arc.  Follow¬ 
ing  Beale  [1],  we  define  the  so-called  "up-costs"  of  an 
arc  as  follows.  For  an  arc  A.  .  with  x. .  ^  0  in  the  arc, 
the  up— cost  of  that  arc  is  the  cost  of  sending  one  addi¬ 
tional  unit  of  flow  from  Ni  to  N.,  i.e., 


Uij(xij)  =  cij(xij  +  ~  cij(xii>  for  Xn  £  0 


If  we  want  to  send  one  unit  of  flow  from  N.  to  N.  where 

J 

there  already  exists  Xj.  ^  0  in  the  arc,  then  the  one 
additional  unit  of  flow  from  N,  to  will  cancel  one  unit 
of  xtj  without  affecting  the  value  v  in  (1).  Hence, the 
cost  of  sending  one  unit  of  flow  from  N.  to  N,, where  there 
already  exists  x^.  £  0,  is  actually  negative. 
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We  shall  call  this  the  "down-cost"  of  an  arc,  i.e. 

the  cost  of  sending  one  unit  of  flow  from  N.  to  Nr  In 
symbols. 


(4) 


dji(xij)  “  cij  ^xij  ^  cij^xij  ~  1)  for  x<  *  >  1- 


1J 


We  shall  assume  throughout  the  Memorandum  that  c..(0)  h  0; 


then  it  follows  from  the  convexity  of  the  cost  functions 


that 


i j  (  )  fcij(xij  +  !)  cij  (°)]xij/(xij  +  1)  >  cij(xjj)  for  >  0. 


Since  (0)  -  0,  we  have 


cij(xij  +  ^  <xij  + 1)  cij(xij)/xij  • 

This  means  the  up-cost  of  an  arc  is  always  positive. 
Similar  reasoning  shows  that  the  down-cost  of  an  arc  is 
always  negative.  Furthermore,  for  any  tv,  nonnegative 
integers  a  and  b  with  a  <  b,  we  have 


(5) 

(6) 


uij  (a)  <  u.^b)  , 
dji(a)  <  dji(b)  . 


For  a  given  network,  let  a  flow  pattern  with  value  v 
be  given  and  denote  its  arc  flows  by  *£>.  Let  another 
flow  pattern  with  v2  be  given  and  denote  its  arc  flow  by 

Xjj  '  If  we  superpose  the  two  flow  patterns,  then  we  get 
a  flow  pattern  with  value  Vj  +  Let  xg>  be  the  arc 
flow  of  this  new  flow  pattern.  Then 


are  of  the  same  directions,  and 


if  Xij)  and  Xij) 

„(3)  .  x(l)  _  (2) 

xij  xij  xij  » 

if  and  x£?'  are  of  the  opposite  directions  and  x^P 

ij  iJ  ij 

is  of  the  greater  magnitude.  We  say  that  two  flow  patterns 
are  conformal  if  and  only  if 


x(3)  _  <1)  .  x(2) 

xij  "  xij  +  xij 


for  all  arcs. 


A  particular  flow  pattern,  called  a  "flow  path,"  is  a 
flow  pattern  with  xg^  =  x-^  =  . . .  =  xnt  =  1.  If  the  cost 
of  a  flow  pattern  with  value  v  is  known,  and  we  superpose 
a  flow  path  on  this  given  flow  pattern,  the  resulting 
pattern  has  value  v  +  1.  The  total  cost  of  the  flow 
pattern  with  value  v  +  1  is  the  sum  of  the  cost  of  the 
flow  pattern  with  value  v, plus  the  sum  of  u. .  and  d..  used 
in  the  flow  path.  The  sum  of  u^j  and  d^j  used  in  the  flow 
path  is  called  the  incremental  cost  of  the  flow  pa:h. 

2 .  ALGORITHM 

The  algorithm  for  solving  the  minimum  convex-cost  flow 
problem  can  be  simply  described  as  follows. 

Starting  with  all  x.  .  =  0,  send  one  unit  of  flow  from 
Ns  to  Nt  along  the  path  whose  incremental  cost  relative  to 
the  existing  flow  pattern  is  minimum.  (This  can  be  done 
by  many  of  the  existing  shortest— path  methods  with  u.  .  and 
dj^  as  the  lengths;  see,  for  example,  [6],  [10]).  Redefine 
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the  u. .  and  d.^  based  on  the  new  flow  pattern  obtained,  and 
send  one  additional  unit  of  flow  along  the  path  with  minimum 
incremental  cost.  The  process  of  using  the  minimum  incre¬ 
mental  cost  path  is  repeated  until  the  total  outflow  of  Ng 
is  v  (or  the  total  inflow  of  Nt  is  v). 

Many  proofs  are  known  for  the  case  where  the  objective 
function  (1)  is  a  linear  function.  In  Beale  [1],  an  algorithm 
is  given  for  a  bipartite  network  with  convex  cost,  and  it  starts 
with  a  feasible  solution.  It  is  easy  to  convert  the  existing 
proofs  and  ideas  into  the  case  of  an  arbitrary  network  and 
convex-cost  functions,  and  to  show  that  at  every  successive 
stage  of  the  algorithm, . the  flow  pattern  is  optimum  for  the 
corresponding  parameter  v.  This  will  be  discussed  later. 

Let  us  give  one  example  to  illustrate  the  algorithm. 


Consider  Fig.  1.  The  cost  function  of  each  arc  is  c. .  xf . 

with  c . .  written  beside  the  arc  and  c..  =  c... 
iJ  Ji 


Fig.  1 
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Assume  a  given  flow  pattern  as  shown  in  Fig.  2. 


Then  the  up-costs  and  down-costs  of  every  arc  are 
calculated  from  (3)  and  (4)  with  the  result  shown  in  Fig.  3, 
where  the  first  number  beside  an  arc  is  the  up-cost,  the 
second  number  is  the  down-cost,  and  the  directions  of  up- 
costs  are  the  same  as  in  the  flow  pattern  of  Fig.  2. 


Fig.  3 


-7- 


For  example,  the  up-cost  of  is  2  ‘  2^  -  2  *  l2  =  6  If  an 

arc  has  no  flow,  like  Ag2,  the  cost  of  flow  from  both 
directions  will  be  4 ’ l2  -  4 '02  =  4 .  If  we  want  tc  send  one 
additional  unit  flow  with  minimum  incremental  cost,  we 
should  use  the  arcs  Ag2,  A^,  and  A^  with  total  incre¬ 
mental  cost  4  +  (-2)  +5=7,  with  the  resulting  flow 
pattern  as  shown  in  Fig.  4. 


3.  APPLICATIONS 

3.1.  Maximum-Flow  Min-Cut  Theorem 

The  problem  of  binding  maximum  flow  through  a  network 

with  b. .  as  the  branch  capacities  of  arcs  can  be  formulated 
as  follows: 

Max  v 


subject  to 
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(7) 

and 


2  x. .  -  2  x 
i  k 


for  j  =  s  . 
for  j  f  s ,  t  . 
for  j  =  t, 


(8)  0  £  xij  £  for  all  i,  j. 

This  problem  can  be  formulated  as  a  minimum  convex- 
cost  flow  problem  as  in  (1)  and  (2)  by  defining 


Cost 


Fig.  5 
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Thc.  v  in  (2)  is  taken  as  a  parameter.  The  maximum  flow  v 
is  obtained  when  the  value  of  the  objective  function  z 
becomes  infinity  for  v  +  1.  This  means  when  the  value  in 
(2)  is  v,  there  is  no  arc  in  the  network  with  infinity 
cost,  and  when  the  value  is  v  +  1,  at  least  one  arc  is 
with  infinity  cost.  Since  we  are  minimizing  z,  there 
must  be  a  set  of  arcs  which  form  a  cut  in  the  flow  pattern 
with  value  v  in  which  all  =  b^j.  Hence, the  value  v  is 

the  maximum-flow  value.  A  proof  as  well  as  an  algorithm 
is  shown  in  Busacker  and  Gower  [3].  We  can  generalize  the 
approach  used  in  [3]  to  solve  the  following  case: 


(9) 

subj  ec  t 

(10) 


min  z 

to 
2  x 

i  ij 


( x .  . ) 

ij 

ij 

/■** 

— V 

jk 

=  4  o 

I  v 

j  =  s  , 
j  +  j,t 
j  =  t  , 


(11)  0  £  x.  j  £  b..  , 

where  in  (9)  z  is  a  sum  of  any  convex— cost  functions.  The 
algorithm  of  always  choosing  the  flow  path  with  minimum 
incremental  cost  works  for  the  case  when  the  objective 
function  is  a  linear  function  (see,  for  example,  [3]),  and 
its  validity  does  not  depend  on  how  many  arcs  connect  the 
two  nodes.  We  shall  transform  equations  (9),  (10;,  and  (11) 
into  a  linear  case  as  follows. 

Consider  an  arc  b. .  as  a  set  of  arcs. each  with  unit 
branch  capacity.  Index  those  arcs  with  positive  integers 
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The  cost  of  the  k-th  arc  from  ^  to  N. 


is 


cijOO  “  c^Oc-l)  if  xtj  -  0  , 

and  the  cost  is  »  if  ■  1.  It  follows  from  the  convexity 
of  that  the  up-costs  of  arcs  from  Ni  to  N.  are 

always  monotonically  increasing  with  the  index  of  the  arcs, 
while  the  down-cost  of  the  k-th  arc  is  negative  if 
it  has  flow.  Assume  that  >  0;  then  if  we  want  to  send 
additional  flow  from  to  N. ,  we  always  use  the  arc  with 
smallest  index  if  that  arc  is  not  saturated^  if  we  want  to 
send  flow  from  N^  to  Ik,  we  always  use  the  saturated  arc 
with  largest  index.  Then  (9)  becomes  a  set  of  linear  cost 
functions  of  those  unit— capacity  arcs,  since  in  no  case 
would  we  use  an  arc  with  infinity  cost. 

— Increasing  the  Capacity  of  a  Network 
This  problem  solved  in  [8]  can  be  stated  as  follows. 

A  network  with  branch  capacity  b^  is  given.  Now,  we  want 
to  increase  the  branch  capacity  or  construct  new  arcs  such 
that  the  maximum  flow  from  Ng  to  Nt  is  increased.  The  cost 
of  increasing  or  constructing  a  unit  branch  capacity  from 
^  to  Nj  is  c£j •  The  problem  is  to  find 

Max  z  *  V 


subject  to  c  =  c . .  y.  . 


^  x .  .  Z  x .  i 
i  1J  k  Jk 


J 


— v  for  j  =  s  , 

0  for  j  +  s,t  , 
(.  v  for  j  =  t  , 


0  '  x .  .  <  b .  .  +  y .  . 

“  !J  1J  *1J  ’ 
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i.e^with  a  given  budget,  we  want  to  maximize  the  flow  from 
N  to  N  by  allocating  y.  .  appropriately. 

SC  1.  J 

This  problem  also  can  be  solved  by  the  algorithm  of 
minimal  incremental  cost  path.  Let  us  define  the  up-cost  and 
down-cost  of  arc  flow  as  follows : 


u.  . (x.  .  ) 
IJ  IJ 

=  0 

if 

x.  . 
ij 

<  b.  .  , 
ij 

u. . (x. . ) 
IJ  IJ 

=  c .  . 
ij 

if 

xij 

>  b.  . 

“  iJ  ’ 

d . . (x.  .  ) 
Ji  iJ 

=  0 

if 

0  < 

x .  .  <  b .  . 
ij  ~  iJ 

d . . (x.  .  ) 
Ji  ij 

ii 

1 

o 

h* 

<_>. 

if 

x .  . 
ij 

>  b.  .  . 
ij 

Then  the  solution  is  to  always  send  from  Ng  to  one  unit 
of  flow  along  the  minimal  incremental  cost  path  (since  we  can 
consider  the  problem  as  min  Z  and  treat  v  as  a  para¬ 

meter),  until  the  total  amount  of  money  used  up  is  c.  Then 


y..  =  x..  —  b. .  if  x..  >  b..  , 
ij  ij  iJ  iJ 


y.  .  =  0 


if  x .  .  <  b .  .  . 
ij  ~  iJ 


3-3-  Electrical  Network 

Consider  a  passive  electrical  network  with  one  current- 

input  source  at  Ng  and  one  current— output  source  at  N^.. 

From  Ohm's  law.  the  electrical  current  x. .  from  N.  to  N.  is 

i  J 

proportional  to  the  potential  difference  and  inversely 

proportional  to  the  resistance  r^^  of  that  arc.  i.e., 

4>.  . 

x  =  -U. 
ij  r..  • 

J  ij 
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The  work  done  by  that  arc  is  x± j  ^  «  r^  x^j  .  To  solve 

an  electrical  network  of  the  above  type,  we  can  solve  the 

simultaneous  equations  given  by  Kirchoff's  node  law  and 

Kirchoff's  loop  law.  Alternatively,  we  can  regard  Kirchoff's 

node  law  as  linear  constraints  of  the  currents  x..,  and 

J 

minimize  the  total  work  done.  This  then  becomes  the  fol¬ 
lowing  quadratic  programming  problem  (see  [5]) : 


for  j  ~  s  , 
for  j  +  s,  t  , 
for  j  -  t  . 


mn  2  -  rtj  x.j 


subject  to 


2  x,  . 
i 


r 
<  0 


Tnis  problem  can  again  be  handled  by  the  minimum  incremental 
cost— path  algorithm  by  defining  costs  of  arcs  as  follows: 

Let 


where 


Uij(xij)  “  rij(2xij  +  X>  if  x.j  >  0  , 

dji.(xij)  "  -rij(2xij  “  if  x.j  >  1  . 

For  given  strengths  of  inflow  current  source  and  outflow 
current  sinks,  we  send  the  current  along  the  minimum 
incremental  cost  path  for  source  tc  the  sink  until  the 
inflow  rate  is  v. 
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3.4.  Laplace  Equations 

The  consideration  of  a  network  problem  as  a  boundary- 
value  problem  was  done  in  [2].  Let  us  consider  the  Laplace 
equation  in  a  region  G: 

(12)  V2  ^  =  0 

with  prescribed  on  the  boundary  of  G.  If  we  use 
difference  equations  to  replace  (12)  and  use  a  uniform 
grid,  then  the  value  of  at  a  point  is  the  average  value 
of  its  four  neighbors  (see  Figs.  6a  ard  6b),  i.e.. 


Fig.  6a 


Fig.  6b 
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(13)  4*0  “  “  *S  ~  ~  "  °- 

Rewriting  (13)  and  letting  x£0  -  ^  -  rfQ,  etc,  we  have 

(14)  XE0  ~  X0W  +  ^iO  “  X0S  *  °- 

Equation  (14)  then  can  be  considered  as  the  conservation- 
H°w  equation,  with  x^g  the  arc  flow  from  node  E  to 
node  0.  The  boundary  condition  of  prescribing  |i[  is  then 
interpreted  as  the  condition  of  inflow  and  outflow  at 
sources  and  sinks  in  a  network.  The  Dirichlet  principle 
(see  for  example  [9])  for  solving  a  Laplace  equation  can  then  be 
regarded  as  that  of  minimizing  a  quadratic  objective  function, 

(15)  min  z  -  2  x^.  , 

subject  to  equation  (14)  at  interior  points  of  region  G 

and  satisfying  the  boundary  condition  x, .  -  ^  at  the 

lj  dn  u 

boundary  of  G. 

We  have  the  objective  function 
z " 2  xij  > 

where 

uij(xij>  -  2Xjj  +1  if  Xy  >  0, 

dji<xij> 2xij  +  1  «  *ij  >  1  • 

Then  the  Laplace  equation  can  be  solved  by  min  incremental 
cost  path  from  sources  to  sinks,  as  done  previously.  Special 
examples  can  be  given  to  show  that  this  approach  is  better. 
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4.  DISCUSSION 

We  have  assembled  several  problems  in  different  areas 
and  shown  that  all  of  them  can  be  solved  by  algorithms 
of  shortest— path  type.  The  distance  functions  (or  cost 
functions  of  arcs),  however,  are  not  fixed  but  depend  on 
the  current  existing  flows  in  the  network,  and  can  be 
negative.  Hence,  we  must  use  iterative-type,  shortest— pa th 
algorithms  such  as  in  [6],  [10].  As  the  flow  patterns  always 
maintain  their  optimality,  there  will  never  be  any  cycle 
of  arcs  in  the  network  for  which  the  total  cost  of  going 
around  the  cycle  is  negative. 
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